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RESE^ AND SYSTEMFQR 

ASYNGHRQNOTTS; TRANSFER MODE COMMUNICATIONS 

■ ■ ■ SPEGIFICATION 

TEGHNTCAT. FTFT n 

5 THis invention relateis generally to broadband integrated services digital ; 

communications networks (B-ISDN) operatihg in asynchronous transfe^^^^ 
and^ more specifically^ to connection management in such networks; 

BACKGROTJ T^ 

Connectivity^ L connection or cpnm 

10 path between in a cpmmunications network is a fundamental task in ' '■:] ■:■[ --^^ 

managemeiit system; In traditional telephone service networks, connection 

managern^ : : ;'; 

interface (>W services on B-ISDN net>yorks 

15 basically amount to ^ extensions of the UNI and NNI standards- 

^^^^^^^^^^^^^^^ : In the 1960s, at the time Men t^^^^ were 

introduced, it was rightly recognized that custoraer premises equipment (GPE) had a! ; 

low level of "inteUigence^ in comparison with the switching equipment, and that the 

user was interested niainly in manipulating the service at its end points. Today these 
20 assumptions are no longer valid, as the CPE often is at least as intelligent as the 

' switch: boiitrbilersr.-" 

^^^^^^^^^^^^^^^^^^ of the connection management system ta^ 

netwoiic services rapidly will be a ke^ 

As ^ high-$p^^^^^ arid cbinmiMiM^ : 

25 bandwidth becpmes a commodity, product differ increasingly riiiy depend on ' 

the level of sophistication^ degree of flexibility and speed of dejiloyriientWhe 
services., ' 
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Recent proposals for providing connectivity service are presented in 
TINA-C, Service Architecture Version 2.0, Document No. TB_MDC.012_2.0_94, 
March 1 995 and by A. A. Lazar et al., ''Realizing a Foundation for Programmability 
of ATM Networks with the Binding ^chitecture", IEEE Journal of Selected Areas in 
5 Communications, Special Issue on Distributed Multimedia Systems, Vol. 14, No. 7, 
September 1996, pp. 1214-1247. According to these proposals, controllers run oh 
general-purpose distributed computing platforais and interact through local or remote 
invocations. This permits signaling activities to be formulated m high-level terms of 
operation instead of low-level rriechamisms. 

10 SUMMARY OF THF INVENTION •. : 

We have recognized that, for efficient connection processing, 
invocation of objects can be par£JleUzed:^^^ W^^^ throughput of : 

• a connection manager can be increased, and the latency of call set-up decreased by 
caching of network states. ALnd we have recognized.!^ throughput 
15 can be increased by aggregating multiple request messages into a single invocation 
in^stead of making multiple invocations v^^^ 

BRIEF DESCRIPTION OF THE DR A WING 

Fig. 1 is a schematic of a representative communications system 
including aspects of the invention, and of object interaction in the system. 
20 ^ Fig. 2 is a schematic of specific components, and of sequenced 

execution of a connection set-up request in the system of Fig. 1. 

Fig; 3 is a schematic which illustra^^^ timing in object call request 
execution in the system of Fig. 1 . 

Fig. 4 is a schematic which illustrates the setting up of VCIA^PI tables 
25 in an ATM network. 

Fig. 5 is a schematic for a preferred connection manager. 

Fig. 6 is a schematic for the interface of the NodeServer object of Fig. 
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DETAILED D gSCRiPTION 

ATM-based broadband networks include computerized s^^ 
connected by communications links which may taJce the fonn of wire, coaxial cable or 
optical fiber connections, for example. They employ cell transpo^^ 
5 include a "payload" and a header with routing information. The header includes two 
: information fields of interest here, namely a vhtuai ch^^i identifier (VGI) and a 

virtual patih identifier (VPI), These are associated with each input and output port of 
switch. 

The input port VCWPIs are mapped into as 
•^•-7^-^;-^7:10 -; to permit every cell arriving at an mput port to be svdtched pmo; the proper o 

; p 

:. svvitch controllers in accordance with instructions fi-orn a computeri connection 

■v^inanager.' - l;':-. 

Setting up Ae^ 

substanti^^^^ switch coritrbllers.Thii^ 

coniiection rnariager is of key importances^ f^^ set-up 
delay in ATM ;het\^ ; T; 

description is 

CORBA^^ The CORE A standard - 

architecture is as doc^^ Object Management 

Fleqiiest Broker: ^clutectwe and Specificatip 
enyironment, the most expensive operatiori^^^ 
^cificityi sudi invocat^ 

Language (IDL). The use of other signaling platfonns, architecturesi protocols and 
languages is not precluded. 

Providing connection services is a baisic task performed by a 
cpMectiohmahageh^ 
required: 

(a) Mapping of user-level qualitv of semce YOOSY to network OPS nos 
abstractions for network resources can be defined for each traffic class using specific 



15 



20 



.25 



30 
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cell loss and cell delay requirements. Service abstractions for customer premises 
equipment such as PCs and work stations are specified in terms of frame rate and 
frame loss, for example. In the present system, a QOSMapper translates the QOS : 
specifications for frames to QOS specifications for ATM cells and vice versa. 
5 (b) Route Selection: The path connecting two endpoints in the netv^ork is ; 

provided fix)m a database here designated as RouteObject: Routes arc updated%^^^^^^":^^^^^^ ; 
independently operating router objects. 

(cV Resource Reservation. These connection manager taslcy; nan he divided 
into two groups: reserving system resources such as buffer, bandwidth, GPU cycles ; ■ : 

10 and tiie like, and reserving and set^ 

transport. changing the bontents of the svvitchi^ 

Instructions for making such changes are issued by the corihection manager the 
conmiunications system, for call/connection confrol. The reservation of system 
resources should be based on abst^^ 

15 system hard\yare, and should provide QOS guaranteeis^ For manipulating the switch 
identifiers, a set of primitives is used as described in further detail by M. G Ghan et 
al, "Service Greatiori, Renegotiation and Adaptive Transport for^^^^ 
Networking", Third COST 237 International Workshop on Multimedia 
Teleconununications and Applications, Barcelona, 25-27 No vember 1996 . The obj ect 

20 regulating access 

Fig. 1 illustrates how objects interact, with communications links 
bet\yeen objects being shown as arrows from source to destination. Shown are ^^^^ i 
connection managers 101, RouteObjects 102, NodeServers 103, QOSMappers 104 
and'ATM'-switches;105.-"v""-\ . 

25 Fig. 2 illustrates how objects shovm in Fig. 1 can be implemented A 

: client's program 200 runs on a Sparc20 work station 201 connected to a local area '^-'il'':'-. 
:: network (LAN) 205. Further connected to the LAN 205 are: an Ultra work station • 
202 including the conriectiori manager 101, the RouteObject 102 and the QOSMapper 
104; two SparclO work stations 203 with NodeServers 103; and ah ASX-iOO or 

30 Sparcl O work station 204 serving as an ATM s\\atch and a^ a NodeServer 

103. Standard OG-3 optical fiber communication links 20(5 with a band^^ 
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Mbits/sec link the work stations 203 and 204 as shown. The usual order of execution 
is indicated by numerals 1 -4 in sequence, representing a set-up request (Step 1 ), QOS 
mapping (Step 2), route selection (Step 3) and resource reservation (Step 4). 

An efficient design of the connection manager takes into account that : 
5 the maj ority of the remote operations during connection set-up have small arguments; 
that remote calls contribute most of thfe latency of call processing, and that most ^ 
computations are executed in the communication layer. Accordingly, the fblldwihg : 
features are included in a prefeited high-perfonnance management system: 
parallelization of object call request execute kept busy as much 

10 as possible; caching of netvvori^ stales- to min^ of remote procedure 

■ aggregation of access to^ l^ objects, tiy cdnibining multiple " 

requests into a single remote invocatiori. 

; ^' Parallelization of Object Call Reque^ to the inh^rpnt 

delay incuired in aqce^ 

^GORBA. ' 

In the upper tune line of Fijg. 3 , calls are represented as invoked - : 
sequentially; Each s^^ has three stages: send, wait 

20 and acknowledge-^ 

time is the sum pjf^the individual waiting times. But if 

performed first before waiting fbr the ickiiowledgments, i.e. if the call executions are 

Eig. 3, where all send messages are performed together, followed by a waiting period^ 
25 and finally by the reception of the acknowledgments; If the waiting time for receiving : ; 
: acknowledgments is much longer than t^^ execution 
: : ; ; has the potential of ^shortening ;& of the individual 

waiting times. Thus, by parallelizing the execution, tiie processo be kept busy for-; 
a longer period of time while imruniizihg^^^^ totM waiting period; thus minimizing the' ' 
; 30 total latency. 
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B- Caching of Network States The throughput of the connection manager 
can be increased and the latency of call set-up decreased by state caching. Five types 
of caching can be performed, namely: 

(i) placing the QOSMapper in the same address space as the conne 
. 5. .. manager, . . 

(ii) caching the most recent routes requested by the RouteObject, 

(iii) cacMng of output or input VCWEIs,^^^^^^^^^ 

(iv) caching of bandwidth and buffer resources, and 

(v) caching of existing connection states. 
'0 As shown in Fig; 2, the connection manager performs remote 

invocations on three classes of objects: QO^ 
For each of these object 
connection manager. 

First, for mininaizing the cost of invocations of the QOSMapper: Since 
15 the mapping performed by the QOSMappef is M 

during the lifetime of the connection nianager, the QOSMapper can be placed in the 
same address space as t^^ 

QOSMapper from the connection manager becomes a local invocation rather than a 
remote invocation. 
0 Second, v^dth respect to mim 

RouteObject: During repeated call set-ups, patterns of ca^ erriefge that have 

the same source-destination pairs. For calls M 

necessary to have the connection manager invoke the RouteObject each time a set-up 
request is received. Instead, when the connection manager receives a r^^ for a 
25 specific source-destination pair from the RouteObject, it will cache the route (or 
alternate routes) with a time stamp associated with each. Statistics 6f route selection 
for the alternate routes can also be included^ By defin^^ 

for route invalidation, of T seconds, say y the coimection manager can use the "cached'* 
; route if it is less than T seconds old. Otherwise^ a new route will be requested. If the 
30 expected call throughput is 100 calls/sec, and the pirobability of a sdurce-destination 
(SD) pair appearing in a call request is 0.01 ^ then, by setting T = 10 sec, there will be 
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one update per 10 seconds per SD pair, instead of 100 x 0.01 x 10 = 10 updates in 10 
seconds, an improvement by a factor of 10. Updates are performed on demand. 
Therefore, if a route "times out", there will be no extra update: 

Third, with respect to the cost of invocations of the switch (routing) 
5 : table, the process of setting up the routing tables in the path of a call is illustrated by 
: Figf 4: Shown are three ATM switches 401-403 connected in seirieis by 

communications links. The process requires two phases. Iri phasdbhe, an output 
VCIA^PI pair is obtained from the output port of each of the ATM sv^tches located in 
the path of the call. In the second phase, the output VGI/VPI pairp ; 
10 switch is m^^ 

V comm operation also is iiKiicated as Step 4 in Fig; 

; : 2. A the output VCI/VPI of the appropriate port of intermediate 

switch i^ the input Vei/ypi. The re\^ input 

foHoAyed by output is 4so feasible. _ 
15 ^^::;^^^T^ (or input) VGIA^PL pairs are known in advance^ the 

entire commit process can be performed in a single phase; When die NodeServers 

can be perfo obtains cohtrdl over a iset of 

: ay 

20 ^ M During coimection set-up time, the corihection meager simply looks 

ior m name space cache. If an aymlable o VCI A^PI 

p 

reservation process can be perf brnied in a single step. In case of a " cache miss" , i.e. if 
no free is aymlable, the normal two-step operation is performed for all 

25 switches vsdtii cache misses. 

By keeping the available VCWPI pairs v^th the c^^ 
instead of the NodeServers, the VG^^ state of an ATM M 

indifferem- vv^s^x/^^:-:-^ 
30 In one approach, the number of VCWPI pairs res^ry^^ port per 

switch is competitively decided among the controllers reserving the resources. Thus, 
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each connection manager adjusts the number of entries (VG WPI pairs) kept in its 
cache depending on tiie call arrival and departure statistics, and how much it is willing 
to pay for a low latency call set-up: In another approach, the size of partitions is 
controlled by a distributed algorithm that attempts to optimize the partitibnihg of the 
5 name spaces on the network level. The two approaches differ in that in the first case, 
the allocation process is performed using the rules of a competitive game, wherea3 in 
the second case the partitioning process is performed in a cooperative manner. 
Combinations of the two approaches are also feasible. 

Fourth; caching of ]?andwidth and buffer resources is similar to 
10 VCIAAPI name space caching and is typically performed per output port. This is ; 
particularly useful for reserving a niinimum amount of bandwidth and buffer space to 
a particular connection manager.; The cooperative and competitive techniques 
described above also apply to the partitioning of bandwidth and buffer 
Fifth, cpncernin^ 

15 up successfully, its state is kept by the connection manaiger. Also, this information is 
: replicated in the NodeSeFvers^ so manager can recover its prior 

state from the NodeSeryers. Ely caching such information locally in the connection 
managers, the state of the existing connectionis can be accessed using local object 
invocations. This information is particularly useful during QOS renegotiations. 

20 Table 1 sho ws aii example of the information cache in the connection 

manager, with only the capacity per port being shown. In Table 1, under "VCIs 
Reserved" -WCI" stands for '! VCI Available^ "S" stands for ^'Source"; "D" for 
"Destination", with further abbreviations being self-explanatory; 
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Table 1 : State Caching on a Gonnection Manager 



End-to^End Connectivity 


Rte.Cacheid: 


VCIs Reserved 


Bandwidth Reserved 


ID 


Existing Connections 


S-D 


Rbut e ^ 


NdePirt 


VGI 


NdePrt 


Resource 




state of connection 
request x 


A-B 


A-E-B 


:.-.,';;a-;5- 


. Bl 


:A 5 


CI 




state of connection • 
request y 


^ A^E 




£ ■■ ■•3 






■ C2 



\--;;;^f ^; -'G. : Aggregate Access to thb N6deS^ 

ehyironmeht where the vast majbrity of bbject interactions are in simple request-reply ; " : ■ 
Ibrm witti small argimierits (less than 1§G^ 

operations are remote invocations. - T^ increase the throughput of the system, multiple ■ 
requests or messages are conrt^ 

multiple individual invocations^ one per i^qviest. As aresultj in a single invocation, 
the argument is a list of commands, each command corresponding to a single request: : 
The number of requests stored in th hiessage buffer before th6sd iare sent out is used 
as a control parameter. 

This technique is adyantagepus in that, by delaying the processing of : 
requests, the total number of remote irivocatioris performed by the connection 
manager decreases. It is especially u^^ 

class of objects most often cpmrnunicated to by the connection manager. With 
reduced load on the NddeServers,: additional connection managers can be added to the 
signaling system, resulting in enhanced throughput with minimal in crease in latency. 
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D- Functional Design of a Preferred Connection Manager. In the 
embodiment illustrated by Fig. 5, the connection manager 10 1 includes a connection 
manager state machine 501 , a QOSMapper 502; a connection state cache 503, a route 
cache 504, a message aggregation module SOS, a name cache 506 and a bandwidth 
5 cache 507. A database RouteObject 102 is linked to receive route information from 
the route cache 504 and to furnish route information to the conh6ction manager state 
machine 501. ANodeServer 103 is linked to receive message aggregates from the 
; : message aggregation module 505 and to serve the connection manag;er state 
machine 501. 

0 The connection manager state rnachine is unaffepte^ caching 

and aggregation schemes. Messages ta be sent to M 

in the message aggregation module, v^dth one queue per rem^^ Messages in 

these queues are actually transmitted when eiliier number of messages reaches a 
threshold which can be dynamicdly set and changed, or^^ Time- 
outs are used as a safety niechahism to ensure to^^ the 
^^^^^^ c^^ long without being processed^ Thej^ are needed w^^ In 

; : ; ; ; most cases, in particular when the request rate is high, niost of the operations are 
performed locally. Relatively infrequently, the connection m^^^ 
invocations to remote objects. 
M To support different modes of invocation, the NodeServer supports 

three classes of mterfaces as illtistrated by Fig. 6.; At the lowest level, the set of 
synchronous remote invocations supported is implemented by a set 601 of functions 
mcluded in Module A. For each of these synchronous techniques, two asynchronous 
techniques 602 are defined so that the aclmowled^ separated from the; 
25 invocation, included in Module B. This serves to support the asynchronous mode of 
invocation. Finally, a generic, asynchrorioxiis techxiique 603 iis included in Module C, 
taking as argument a list that can be used to represent a^^^^ 
"techniques -in Module-B. ■ '-^- ^^y', 

A system as described ^c^ 
30 software modules, with no heed for s^^^ 
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CLAIMS 

1 . An ATM call processing method comprising: 

obtaining connection requests, with each connection request having at 
least first and second stages to be processed; 
5 caching a plurality of the connection requests; and 

processing the first stages of the plurality of connection requests 

followed by 

processing tiie second stages of the plurality of cciimectiori requests. 

■ ■ ■ 2: ; The ATM call processing method according to claiin 1; wherein each 
10 of the coimection requests coniprises a "sen^ stage, ai "wait":st^ 
"acknowledge" stage. • : 



:.:;;3v. An ATM call processing system comprising: ; 

311 luput for coimcction requests, with each connection request having 
at least firsthand jsecbnd stages to bb processed; 
15 acache for a plurality of the connection requests; and 

a processor mstructed for processing the first stages of the cached 
plurality of cdimection requests followed by processing the second stages of the 
cached plurality of connection requests . 

4. An ATM call processing system comprising: 
20 a connection nianager for issuing ATM routing instructions to switch 

controllers; and 

a quality-of service mapper pperatively coupled to the connection 
manager for mapping between specifications for different communications service 

'"'■modes;: :::-- . v '.....'.':;;/ 

25 wherein the connection manager and the quality rof-service mapper are 

disposed in a shared address space. 
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5. The ATM call processing system according to claim 4, wherein one of 
the specifications comprises user frame specifications and another of the 
specifications comprises ATM cell specifications. 

6. An ATM call processing method comprising 
5 obtaining a connection request; 

referring to a cache of prior network sta^^ and 
determining whether one of the prior network states can be used in 
satisfying the request and, if so, i^^^^ network state in satisfying the requ^^^^ 

7. ; : The ATM call processing method according to claim 6, wherein the ^ 
10 cache comprises prior routes requested; 

8. The ATM call processing method according to claim 6, wherein the ; 

cache; :cpniprises'na^ ■ 

9. The ATM call processing method according to claim 8, wherein the ; 
names are output VGI/VPIs. 

1 5 10. The ATM call processing method according to claim 8, wherein the 

names are input Vei/VPIs. 

11. The ATM call processing method according to claini 8^ wherein the 
names are VGI/VPISi and further comprising competitive bidding in reserving a 
number of VGI/VPI pairs per port per switch. 

20 12. The ATM call processing method according to claim 8, wherein the 

names are YGWI^Is^ and fi^ 

reserving a number of VGWPI pairs pe^^^ per switch. 
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13. The ATM call processing method according to claim 6, wherein the 
cache comprises bandwidth and/or buffer information. 

14. The ATM cdl processiiig method according to claim 

; comprising competitive bidding in bandwidth and/or buffer allocation. 

5 15. The ATM call processing method according to claim 13, further 

; ; comprising distributed optiinization pb buffer allocation. 

16. The ATM call processing method according to claim 6, wherein the 

: 17. An ATM call processing system comprising 

.. an'in^ 
a cache for prior network states ; and 
a processor insitaic^ 

; ; if so^ 

using that network state in satisfying the current request. 

y ■ 18; An ATM 

obtaining connection requests; 
caching, fro 

requests whose proceissirig re^ and 
invoking the con^non network object^ 

:2Q'";.-;^requests, .v*. . 

; - 19. : An ATM processing system comprising: 
•:• an input for com^ 
a selector for selecting from a plurality of ■ : 



25 object; 
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a cache for the selected connection requests; and 
a processor instructed for processing the cached connection requests. 

20. An ATM call processing system comprising: 

a connection manager state machdne; 

a message aggregation module operatively coupled to the 
manager state machine for aggregating messages from t^^^ manager state 

machine, and operatively coupled to at least one node server module which is 
operatively coupled to the connection ihariager state m^ 



operatively coupled to a route database object vvhich is operatively c 



a route cache module operatively coupled to the connection manager 
lO; for receiving route information from the coime^ction manager state machine, and 





and 



15 operatively coupledi to the connection manager state macW and 



a 




to the connection 
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